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Abstract 


We present an approach to non-uniform complexity in which single- 
pass instruction sequences play a key part, and answer various ques- 
tions that arise from this approach. We introduce several kinds of 
non-uniform complexity classes. One kind includes a counterpart of 
the well-known non-uniform complexity class P/poly and another kind 
includes a counterpart of the well-known non-uniform complexity class 
NP/poly. Moreover, we introduce a general notion of completeness 
for the non-uniform complexity classes of the latter kind. We also 
formulate a counterpart of the well-known complexity theoretic conjec- 
ture that NP Z P/poly. We think that the presented approach opens 
up an additional way of investigating issues concerning non-uniform 
complexity. 

Keywords: non-uniform complexity class, single-pass instruction se- 
quence, projective Boolean function family 


1 Introduction 


The aim of this paper is to draw attention to an approach to non-uniform 
complexity which is based on the simple idea that each Boolean function 
can be computed by a single-pass instruction sequence that contains only 
instructions to read and write the contents of Boolean registers, forward 
jump instructions, and a termination instruction. 

In the first place, we introduce a kind of non-uniform complexity classes 
which includes a counterpart of the classical non-uniform complexity class 


‘Informatics Institute, Faculty of Science, University of Amsterdam, Science Park 904, 
1098 XH Amsterdam, the Netherlands, Email: {J.A.Bergstra,C.A.Middelburg}@uva.nl. 


48 J.A. Bergstra, C.A. Middelburg 


P/poly and formulate a counterpart of the well-known complexity theoretic 
conjecture that NP Z P/poly. Some evidence for this conjecture is the 
Karp-Lipton theorem [17]. The counterpart of the conjecture formulated in 
this paper is called the non-uniform super-polynomial complexity conjecture. 
The counterpart of P/poly is denoted by IS},\poly. 


Over and above that, we introduce a kind of non-uniform complexity 
classes which includes a counterpart of the non-uniform complexity class 
NP/poly and introduce a general notion of completeness for the complexity 
classes of this kind. This general notion of completeness is defined using 
reducibility relations that can be regarded as non-uniform variants of the 
reducibility relation in terms of which NP-completeness is usually defined. 
The counterpart of NP/poly is denoted by IS},;\\poly. 


We show among other things that the complexity classes P/poly and 
NP/poly coincide with the complexity classes IS,,\poly and IS},\\poly, re- 
spectively, and that a problem closely related to 35AT, and used to formulate 
the counterpart of the conjecture that NP Z P/poly, is NP-complete and 
1S,,\\poly-complete. 


In computer science, the meaning of programs usually plays a prominent 
part in the explanation of many issues concerning programs. Moreover, what 
is taken for the meaning of programs is mathematical by nature. Yet, it is 
customary that practitioners do not fall back on the mathematical meaning 
of programs in case explanation of issues concerning programs is needed. 
They phrase their explanations from an empirical perspective. An empirical 
perspective that we consider appealing is the perspective that a program is in 
essence an instruction sequence and an instruction sequence under execution 
produces a behaviour that is controlled by its execution environment in the 
sense that each step of the produced behaviour actuates the processing of an 
instruction by the execution environment and a reply returned at completion 
of the processing determines how the behaviour proceeds. 


An attempt to approach the semantics of programming languages from 
the perspective mentioned above is made in [5]. The groundwork for the 
approach is an algebraic theory of single-pass instruction sequences, called 
program algebra, and an algebraic theory of mathematical objects that 
represent the behaviours produced by instruction sequences under execution, 
called basic thread algebra. The main advantages of the approach are 
that it does not require a lot of mathematical background and that it is 
more appealing to practitioners than the main approaches to programming 
language semantics. 
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As a continuation of the work on the above-mentioned approach to 
programming language semantics, the notion of an instruction sequence 
was subjected to systematic and precise analysis using the groundwork laid 
earlier. This led among other things to expressiveness results about the 
instruction sequences considered and variations of the instruction sequences 
considered (see e.g. [11, 12]). As another continuation of the work on the 
above-mentioned approach to programming language semantics, selected 
issues relating to well-known subjects from the theory of computation and 
the area of computer architecture were rigorously investigated thinking in 
terms of instruction sequences (see e.g. [8, 9]). The general aim of the work 
in both continuations mentioned is to bring instruction sequences as a theme 
in computer science better into the picture. The work presented in this 
paper forms a part of the last mentioned continuation. 


The starting-point of program algebra is the perception of a program 
as a single-pass instruction sequence, i.e. a finite or infinite sequence of 
instructions of which each instruction is executed at most once and can 
be dropped after it has been executed or jumped over. This perception 
is simple, appealing, and links up with practice. The concepts underlying 
the primitives of program algebra are common in programming, but the 
particular form of the primitives is not common. The predominant concern 
in the design of program algebra has been to achieve simple syntax and 
semantics, while maintaining the expressive power of arbitrary finite control. 


The objects considered in basic thread algebra represent in a direct way 
the behaviours produced by instruction sequences under execution: upon each 
action performed by such an object, a reply from an execution environment, 
which takes the action as an instruction to be processed, determines how it 
proceeds. The objects concerned are called threads. A thread may make use 
of services, i.e. components of the execution environment. Once introduced 
into threads and services, it is rather obvious that each Turing machine can 
be simulated by means of a thread that makes use of a service. The thread 
and service correspond to the finite control and tape of the Turing machine. 


The approach to complexity followed in this paper is not suited to 
uniform complexity. This is not considered a great drawback. Non-uniform 
complexity is the relevant notion of complexity when studying what looks 
to be the major complexity issue in practice: the scale-dependence of what 
is an efficient solution for a computational problem. 


This paper is organized as follows. First, we survey program algebra 
and basic thread algebra (Section 2). Next, we survey an extension of basic 
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thread algebra concerning the interaction of threads with services and give a 
description of Boolean register services (Sections 3 and 4). Then, we introduce 
the kind of complexity classes that includes IS,,\poly and formulate the non- 
uniform super-polynomial complexity conjecture (Sections 5, 6 and 7). After 
that, we introduce the kind of complexity classes that includes IS;,\\poly 
and the notion of completeness for the non-uniform complexity classes of this 
kind (Sections 8 and 9). We also introduce two additional kinds of complexity 
classes suggested by the counterpart of 35AT used to formulate the non- 
uniform super-polynomial complexity conjecture (Section 10). Finally, we 
make some concluding remarks (Section 11). 

Some familiarity with classical computational complexity is assumed. 
The relevant notions are explained in many textbooks, including [1, 3, 
15]. Their precise definitions in different publications differ slightly. The 
definitions of classical notions on which some results in this paper are based 
are the ones from Chapters 1, 2 and 6 of [1]. 

This paper supersedes [7] and Section 5.2 of [10] in several respects. 
Generalization of the definitions of the complexity classes IS,,;\poly and 
IS,,\\poly has put these complexity classes into a broader context, and a 
major technical change has made it possible to simplify the material that is 
concerned with the complexity class IS,,\\poly. Moreover, two additional 
kinds of complexity classes are introduced, and various additional results 
are given. 


2 Program Algebra and Basic Thread Algebra 


In this section, we survey PGA (ProGram Algebra) and BTA (Basic Thread 
Algebra) and make precise in the setting of BTA which behaviours are 
produced on execution by the instruction sequences considered in PGA. 

In PGA, it is assumed that there is a fixed but arbitrary set 2 of basic 
instructions. The intuition is that the execution of a basic instruction may 
modify a state and produces a reply at its completion. The possible replies 
are T and F. The actual reply is generally state-dependent. Therefore, 
successive executions of the same basic instruction may produce different 
replies. The set 21 is the basis for the set of instructions that may occur in 
the instruction sequences considered in PGA. The elements of the latter set 
are called primitive instructions. 

PGA has the following primitive instructions: 


e for each a € 2, a plain basic instruction a; 
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for each a € 2, a positive test instruction +a; 
for each a € 2, a negative test instruction —a; 
for each 1 € N, a forward jump instruction #1; 


a termination instruction !. 


We write 3 for the set of all primitive instructions. 


have 


On execution of an instruction sequence, these primitive instructions 
the following effects: 


the effect of a positive test instruction +a is that basic instruction a is 
executed and execution proceeds with the next primitive instruction if 
T is produced and otherwise the next primitive instruction is skipped 
and execution proceeds with the primitive instruction following the 
skipped one — if there is no primitive instruction to proceed with, 
inaction occurs; 


the effect of a negative test instruction —a is the same as the effect of 
+a, but with the role of the value produced reversed; 


the effect of a plain basic instruction a is the same as the effect of 
+a, but execution always proceeds as if T is produced; 


the effect of a forward jump instruction #/ is that execution proceeds 
with the [th next primitive instruction of the instruction sequence 
concerned — if J equals 0 or there is no primitive instruction to 
proceed with, inaction occurs; 


the effect of the termination instruction ! is that execution terminates. 


PGA has one sort: the sort IS of instruction sequences. We make this 


sort explicit to anticipate the need for many-sortedness later on. To build 
terms of sort IS, PGA has the following constants and operators: 


e for each u € J, the instruction constant u:—- IS; 


e the binary concatenation operator _;_:IS x IS— IS; 


e the unary repetition operator _”:IS > IS. 
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Table 1: Axioms of PGA 
(X;Y);Z7=X;(Y;Z) PGAIL 
(x")" = xX PGA2 
XY: Y= xe PGA3 
(X;Y)*=Xs(Y;X)" PGA 


Terms of sort IS are built as usual. Throughout the paper, we assume that 
there are infinitely many variables of sort IS, including X,Y, Z. We use infix 
notation for concatenation and postfix notation for repetition. 

A closed PGA term is considered to denote a non-empty, finite or even- 
tually periodic infinite sequence of primitive instructions.? The instruction 
sequence denoted by a closed term of the form P ; Q is the instruction 
sequence denoted by P concatenated with the instruction sequence denoted 
by Q. The instruction sequence denoted by a closed term of the form P” is 
the instruction sequence denoted by P concatenated infinitely many times 
with itself. 

Closed PGA terms are considered equal if they represent the same 
instruction sequence. The axioms for instruction sequence equivalence are 
given in Table 1. In this table, n stands for an arbitrary natural number 
greater than 0. For each n > 0, the term P”, where P is a PGA term, is 
defined by induction on n as follows: P! = P and P"™+! = P; P”. The 
unfolding equation X” = X ; X“ is derivable. Each closed PGA term is 
derivably equal to a term in canonical form, i.e. a term of the form P or 
P;Q”, where P and Q are closed PGA terms in which the repetition operator 
does not occur. 

A typical model of PGA is the model in which: 


e the domain is the set of all finite and eventually periodic infinite 
sequences over the set 3 of primitive instructions; 


e the operation associated with ; is concatenation; 


e the operation associated with “ is the operation & defined as follows: 


— if U isa finite sequence, then U“ is the unique eventually periodic 


? An eventually periodic infinite sequence is an infinite sequence with only finitely many 
distinct suffixes. 
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infinite sequence U’ such that U concatenated n times with itself 
is a proper prefix of U’ for each n € N; 


— if U is an eventually periodic infinite sequence, then U¥ is U. 


To simplify matters, we confine ourselves to this model of PGA, which is an 
initial model of PGA, for the interpretation of PGA terms. In the sequel, 
we use the term instruction sequence for the elements of the domain of this 
model, and we denote the interpretations of the constants and operators in 
this model by the constants and operators themselves. 

In the remainder of this paper, we consider instruction sequences that 
can be denoted by closed PGA terms in which the repetition operator does 
not occur. Below, we will make precise which behaviours are produced by 
instruction sequences that can be denoted by closed PGA terms in which 
the repetition operator does not occur. 

First, we survey BTA, an algebraic theory of mathematical objects 
which represent in a direct way the behaviours produced by instruction 
sequences under execution. 

In BTA, it is assumed that a fixed but arbitrary set A of basic actions, 
with tau ¢ A, has been given. Besides, tau is a special basic action. We 
write Atau for AU {tau}. 

The objects considered in BTA are called threads. A thread represents 
a behaviour which consists of performing basic actions in a sequential fashion. 
Upon each basic action performed, a reply from an execution environment 
determines how the thread proceeds. The possible replies are the Boolean 
values T and F. Performing tau, which is considered performing an internal 
action, will always lead to the reply T. 

BTA has one sort: the sort T of threads. We make this sort explicit to 
anticipate the need for many-sortedness later on. To build terms of sort T, 
BTA has the following constants and operators: 


e the inaction constant D:— T; 
e the termination constant S:—> T; 


e for each aw € Atay, the binary postconditional composition operator 
_dab_:Tx ToT. 


Terms of sort T are built as usual. Throughout the paper, we assume that 
there are infinitely many variables of sort T, including x,y,z. We use infix 
notation for postconditional composition. 
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Table 2: Axiom of BTA 
xdtauby=adtaubas T1 


We introduce basic action prefizing as an abbreviation: a op, where p 
is a BTA term, abbreviates pial p. We identify expressions of the form 
ao p with the BTA term they stand for. 

The thread denoted by a closed term of the form p dal q will first 
perform a, and then proceed as the thread denoted by p if the reply from 
the execution environment is T and proceed as the thread denoted by gq if 
the reply from the execution environment is F. The thread denoted by D 
will become inactive and the thread denoted by S will terminate. 

BTA has only one axiom. This axiom is given in Table 2. Using 
the abbreviation introduced above, axiom T1 can be written as follows: 
x itauby=tauog. 

Each closed BTA term denotes a finite thread, i.e. a thread with a finite 
upper bound to the number of basic actions that it can perform. Infinite 
threads, i.e. threads without a finite upper bound to the number of basic 
actions that it can perform, can be defined by means of a set of recursion 
equations (see e.g. [6]). Regular threads, i.e. finite or infinite threads that 
can only be in a finite number of states, can be defined by means of a finite 
set of recursion equations. 

The behaviours of the instruction sequences denoted by closed PGA 
terms are considered to be regular threads, with the basic instructions taken 
for basic actions. All regular threads in which tau does not occur represent 
behaviours of instruction sequences that can be denoted by closed PGA 
terms (see Proposition 2 in [21]). Closed PGA terms in which the repetition 
operator does not occur correspond to finite threads. 

Henceforth, we will write PGAg, for PGA without the repetition op- 
erator and axioms PGA2—PGA4, and we will write ISg, for the set of all 
instruction sequences that can be denoted by closed PGAg,, terms. Moreover, 
we will write length(U), where U € ISgy, for the length of U. 

We combine PGAg, with BTA and extend the combination with the 
thread extraction operator |_|: IS — T and the axioms given in Table 3. In 
this table, a stands for an arbitrary basic instruction from 2, u stands for an 
arbitrary primitive instruction from 3, and | stands for an arbitrary natural 
number. 

For each closed PGAg, term P, |P| denotes the behaviour produced 
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Table 3: Axioms for the thread extraction operator 


a|=aoD #1| =D 
a;X|=ao|X| #0;X|=D 
+a|=aoD #1; X|= |X| 
t+a;X|=|X| dab |#2;X| |#l+2;u) =D 
—al|=aoD #14+2;u;X|=|#l4+1;X| 
—a;X|=|#2;X|dab |x| |!!=S 

1;X|=S 


by the instruction sequence denoted by P under execution. The use of a 
closed PGAgy, term is sometimes preferable to the use of the corresponding 
closed BTA term because thread extraction can give rise to a combinatorial 
explosion. For instance, suppose that p is a closed BTA term such that 


k x 
——_— ooo) 
p=|ta;+b;...;+a;+b;c;!]. 


Then the size of p is greater than 2*/?. 


3 Interaction of Threads with Services 


A thread may perform a basic action for the purpose of requesting a named 
service provided by an execution environment to process a method and to 
return a reply to the thread at completion of the processing of the method. 
In this section, we survey the extension of BTA with services and operators 
that are concerned with this kind of interaction between threads and services. 

It is assumed that a fixed but arbitrary set F of foci has been given. Foci 
play the role of names of the services provided by an execution environment. 
It is also assumed that a fixed but arbitrary set M of methods has been 
given. For the set A of basic actions, we take the set {f.m| f€ F,me My}. 
Performing a basic action f.m is taken as making a request to the service 
named f to process method m. 

A service is able to process certain methods. The processing of a method 
may involve a change of the service. The reply value produced by the service 
at completion of the processing of a method is either T, F or B. The special 
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reply B, standing for blocked, is used to deal with the situation that a service 
is requested to process a method that it is not able to process. 
The following is assumed with respect to services: 


e a many-sorted signature is has been given that includes the following 
sorts: 
— the sort S of services; 


— the sort R of replies; 
and the following constants and operators: 


— the empty service constant 6:—S; 
— the reply constants T,F,B:—>R; 
— for each m € M, the derived service operator a :S—-S; 


— for each m € M, the service reply operator 0m :S > R; 
e a minimal \is-algebra S has been given in which T, F, and B are 
mutually different, and 
= Nie 3 (z) = 2 h\0n 2) B= — 0: holds: 
— for each me M, &(z) =6 © Om(z) =B holds. 


> Om 


The intuition concerning eo and 0m is that on a request to service S$ 
to process method m: 


e if 0m(S) # B, S processes m, produces the reply a(S), and then 
proceeds as 32(9); 


e if 0m(S) = B, S is not able to process method m and proceeds as 6. 


The empty service 6 itself is unable to process any method. 
We introduce the following additional operators: 


e for each f € F, the binary use operator _ /f_:T x S > T; 
e for each f € F, the binary apply operator _es _:TxS—S. 


We use infix notation for the use and apply operators. 

The thread denoted by a closed term of the form p /¢ S and the service 
denoted by a closed term of the form pe, S are the thread and service, 
respectively, that result from processing the method of each basic action of 
the form f.m that the thread denoted by p performs by the service denoted 
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Table 4: Axioms for the use operators 


S/po=5 Ul 
D/;S=D U2 
(tauo a) /p S =tauo (ax /p S) U3 
(x gmb y) /pS=(x/sS)Sg.mb (y/;S) if fA U4 
(fab y) /p$=tauo(e/; 2(S)) if On(S) =T UB 
(a I f.mB y) /¢ S = tauo (y /¢ 3, (5)) if Om(S) =F U6 
(cd fmby)/pS =tauoD if Om(S) =B U7 
Table 5: Axioms for the apply operators 
Sep S=S Al 
Dep S=5 A2 
(tauoxr)erS =xe,S A3 
(xdgmb y)erp S=6 if fA#g A4 
(xi fimb y)er S= rer 38 if Om(S) = T A5 
(xi f.mb& y) es 38 if 0m(S) =F A6 
(xd fm y) eg if Qm(S) =B AZ 


by S. When the method of a basic action of the form f.m performed by a 
thread is processed by a service, the service changes in accordance with the 
method concerned and affects the thread as follows: the basic action turns 
into the internal action tau and the two ways to proceed reduce to one on 
the basis of the reply value produced by the service. 


The axioms for the use operators are given in Table 4 and the axioms 
for the apply operators are given in Table 5. In these tables, f and g stand 
for arbitrary foci from F, m stands for an arbitrary method from M, and 
S stands for an arbitrary term of sort S. The axioms simply formalize the 
informal explanation given above and in addition stipulate what is the result 
of use and apply if inappropriate foci or methods are involved. 

The extension of BTA described in this section is a simple version of 
the extension of BTA presented in [9]. We have chosen to use the former 
extension because it is adequate to the purpose of this paper and it allows a 
terser survey. 
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4 Instruction Sequences Acting on Boolean Reg- 
isters 


In our approach to computational complexity, instruction sequences that 
act on Boolean registers play a key part. Preceding the presentation of 
this approach, we describe in this section services that make up Boolean 
registers, introduce special foci that serve as names of Boolean registers, and 
describe the instruction sequences that matter to the kinds of complexity 
classes introduced in this paper. 

First, we describe services that make up Boolean registers. The Boolean 
register services are able to process the following methods: 


e the set to true method set:T; 
e the set to false method set:F; 


e the get method get. 


We write M,, for the set {set:T,set:F, get}. It is assumed that Mp, C M. 
The methods that Boolean register services are able to process can be 
explained as follows: 


e set:T: the contents of the Boolean register becomes T and the reply is 
qT; 


e set:F: the contents of the Boolean register becomes F and the reply is 
F; 


e get: nothing changes and the reply is the contents of the Boolean 
register. 


For Us, we take the signature that consists of the sorts, constants and 
operators that are mentioned in the assumptions with respect to services 
made in Section 3 and a constant BR» of sort S for each b € 

For S, we take a minimal \s-algebra that satisfies the eonditous that 
are mentioned in the assumptions with respect to services made in Section 3 
and the following conditions for each b € B: 


pet (BRy) = BRr, — 52 ( BR») = BRp, 

ace (BR) = BRr , 2. (BR») =6 if m € {set:T, set:F, get} , 
Oset:T(BRy) =T , Oget(BRy) = b, 

eB) =P, Onl BRAY) SB if m ¢ {set:T, set:F, get} . 
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In the instruction sequences which concern us in the remainder of this 
paper, a number of Boolean registers is used as input registers, a number of 
Boolean registers is used as auxiliary registers, and one Boolean register is 
used as output register. 

It is assumed that in:1,in:2,...€ F, aux:1,aux:2,... € F, and out € F. 
These foci play special roles: 


e for each 7 € N*, in:i serves as the name of the Boolean register that is 
used as ith input register in instruction sequences; 


e for each i € N*, aux:i serves as the name of the Boolean register that 
is used as ith auxiliary register in instruction sequences; 


e out serves as the name of the Boolean register that is used as output 
register in instruction sequences. 


Henceforth, we will write Fin for {in:i |i € Nt} and Faux for {aux:i | ie NT}. 

ISp; is the set of all instruction sequences from ISg, in which all plain 
basic instructions, positive test instructions and negative test instructions 
contain only basic instructions from the set 


{f.get | f © Fin U Faux} U {f-set:b | f © Faux U {out} Ab € B} ; 


ISpy is the set of all instruction sequences from [Sgn that matter to the kinds 
of complexity classes which will be introduced in this paper. 

For each k,l € N, we will write Ish for the set of all X € ISp, that 
satisfy: 


e primitive instructions of the forms aux:i.m, +-aux:7.m and 
—aux:i.m with 7 > k do not occur in X; 


e primitive instructions of the form #l/ with I’ > 1 do not 
occur in X. 


Moreover, for each k € N, we will write Si for the set Ujen Iss Hence, 
18? is the set of all instruction sequences from ISp; in which no auxiliary 
registers are used, and is is the set of all instruction sequences from IS?. 
in which jump instructions do not occur. 
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5 The Complexity Classes /S\F 


In this section, we introduce a kind of non-uniform complexity classes which 
includes a counterpart of the complexity class P/poly in the setting of 
single-pass instruction sequences. 

The counterpart of P/poly defined in this section is denoted by IS,,\poly. 
Because it is isomorphic to the complexity class P/poly, we could have 
decided to loosely denote this complexity class by P/poly as well. The 
reason why we decided not to denote it by P/poly finds its origin in what 
we want to achieve with this paper: illustrating an approach to non-uniform 
complexity in which single-pass instruction sequences play a key part. We 
reserve the use of the name P/poly to where results obtained in the setting 
of Turing machines or the setting of Boolean circuits are involved. 

In the field of computational complexity, it is quite common to study the 
complexity of computing functions on finite strings over a binary alphabet. 
Since strings over an alphabet of any fixed size can be efficiently encoded 
as strings over a binary alphabet, it is sufficient to consider only a binary 
alphabet. We adopt the set B as preferred binary alphabet. 

An important special case of functions on finite strings over a binary 
alphabet is the case where the value of functions is restricted to strings 
of length 1. Such a function is often identified with the set of strings of 
which it is the characteristic function. The set in question is usually called a 
language or a decision problem. The identification mentioned above allows 
of looking at the problem of computing a function f :B* — B as the problem 
of deciding membership of the set {w € B* | f(w) = T}. 

With each function f : B* > B, we can associate an infinite sequence 
(fn)nen Of functions, with f, :B” — B for every n € N, such that f, is 
the restriction of f to B” for each n € N. The complexity of computing 
such sequences of functions, which we call Boolean function families, by 
instruction sequences is our concern in the remainder of this paper. One 
of the classes of Boolean function families with which we concern us is 
ISp,\poly, the class of all Boolean function families that can be computed 
by polynomial-length instruction sequences from ISp,. 

An n-ary Boolean function is a function f :B” — B, and a Boolean 
function family is an infinite sequence (fr),,cn of functions, where f, is an 
n-ary Boolean function for each n € N. 

A Boolean function family (fn) ,cn can be identified with the unique 
function f :B* — B such that for each n € N, for each w € B”, f(w) = fr(w). 
Considering sets of Boolean function families as complexity classes looks 
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to be most natural when studying non-uniform complexity. We will make 
the identification mentioned above only where connections with classical 
complexity classes such as P/poly are made. 

Let n EN, let f : B” > B, and let X € ISp,. Then X computes f if 
there exists an 1 € N such that for all b1,...,b, € B: 


( o (G a (|X| Jains BRr) see joined BRr) fines BR», ) tee fien BR»,,) ®out BRE 
= BR ,,....0n) 

Moreover, let JS C ISp, and F C {h| h: NN}. Then IS\F is the class of 

all Boolean function families (fn),cy that satisfy: 


there exists an h € F' such that for all n € N there exists an 
X € IS such that X computes f, and length(X) < h(n). 


Henceforth, we will write poly for {h | h: N+ NA his polynomial}. We 
are primarily interested in the complexity class IS,;\poly,* but we will also 
pay attention to other instantiations of the general definition just given. 

The question arises whether all n-ary Boolean functions can be computed 
by an instruction sequence from ISp,. This question can answered in the 
affirmative. They can even be computed, without using auxiliary Boolean 
registers, by an instruction sequence that contains no other jump instructions 
than #2. 


Theorem 1 For eachn €N, for each n-ary Boolean function f :B" > B, 
there exists an X € liche in which no other jump instruction than #2 occurs 
such that X computes f and length(X) = O(2").° 


Proof: Let inseq, be the function from the set of all n-ary Boolean 
function f :B” > B to IS?. defined by induction on n as follows: 


inseqg(f) 


_ | —out.set:T ; #2;! if f( 
+out.set:F ;#2;! if f( 
insednyi(f) = —inin-+L.get ; #2; inseq, (fr) ; insean(fr) . 


3In the extension of BTA presented in [9], which has a sort of (named) service families 
and a service family composition operator (@), the left-hand side of this equation can be 
written as follows: (|X| / ((jL_, ini.BRo,) © (Dja aux:j.BRp))) e out. BR. 

“In precursors of this paper, the temporary name P* is used for the complexity class 
ISpr\poly (see e.g. [7]). 

°Theorem 1 sharpens the result found in precursors of this paper (see e.g. [7]). We owe 
the sharpened result to Inge Bethke from the University of Amsterdam. 
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where for each f : B’+! + B and b € B, fy): B" > B is defined as follows: 


fpOts sega) S FORGO) 


It is easy to prove by induction on n that |#2; inseq,,( fr); X| = |X|. Using 
this fact, it is easy to prove by induction on n that inseq,,(f) computes f. 
Moreover, it is easy to see that length(inseq,,(f)) = O(2”). 


Henceforth, we will use the notation [S\O(f(n)) for the complexity 
class [S'\ {h | h:N>NAh(n) = O(f(n))}. This notation is among other 
things used in the following corollary of Theorem 1. 


Corollary 1 All Boolean function families belong to IS?,\O(2"). 


In the proof of Theorem 1, the instruction sequences yielded by the 
function inseq,, contain the jump instruction #2. Each occurrence of #2 
belongs to a jump chain ending in the instruction sequence —out.set:T ; #2;! 
or the instruction sequence +out.set:F ; #2;!. Therefore, each occurrence of 
#2 can safely be replaced by the instruction +out.set:F, which like #2 skips 
the next instruction. This leads to the following corollary. 


Corollary 2 1S/*°\O0(2") = IS?,\O(2”) = ISp,\O(2"). 


We consider the proof of Theorem 1 once again. Because the content 
of the Boolean register concerned is initially F, the question arises whether 
out.set:F can be dispensed with in instruction sequences computing Boolean 
functions. This question can be answered in the affirmative if we permit the 
use of auxiliary Boolean registers. 


Theorem 2 Let n €N, let f:B” > B, and let X € ISp, be such that X 
computes f. Then there exists a Y € ISp, in which the basic instruction 


out.set:F does not occur such that Y computes f and length(Y) is linear in 
length(X). 


Proof: Let o € Nt be such that the basic instructions aux:o.set:T, 
aux:o.set:F, and aux:o.get do not occur in X. Let X’ be obtained from 
X by replacing each occurrence of the focus out by aux:0. Suppose that 
X'=uz;...; ug. Let Y be obtained from wu, ;...; ug as follows: 


1. stop if uz =!; 


2. stop if there exists no j € [2,k] such that uj;_; ¥ out.set:T and u; =}; 
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3. find the least 7 € [2,k] such that uj_1 ¥ out.set:T and u; =!; 

4. replace u; by +aux:o.get ; out.set:T ; |; 

5. for each i € [1,k], replace u; by #/+2 if u, = #l andi<j <i+l; 
6. repeat the preceding steps for the resulting instruction sequence. 


It is easy to prove by induction on & that the Boolean function computed 
by X and the Boolean function computed by Y are the same. Moreover, it 
is easy to see that length(Y) < 3-length(X). Hence, length(Y) is linear in 
length(X). 


The following proposition gives an upper bound for the number of 
instruction sequences from igen of length k that compute an n-ary 
Boolean function. From each instruction sequence from ISp; of length k 
that computes an n-ary Boolean function, we can obtain an instruction 
sequence from ise of length k that computes the same n-ary Boolean 
function by replacement of the primitive instructions that are not permitted 
in Ist ee, Moreover, each n-ary Boolean function that can be computed 
by an instruction sequence from IS,, of length less than k, can also be 
computed by an instruction sequence from ISp, of length k. 

Proposition 1 For each k € N* and n €N, the number of instruction 
sequences from Ispee" of length k that compute an n-ary Boolean function 
is not greater than (3n + 10k — 2)*. 


Proof: The set of basic instructions from which the plain basic in- 
structions, positive test instructions and negative test instructions occur- 
ring in the instruction sequences concerned are built consists of n basic 
instructions of the form in:i.get, & — 1 basic instructions of each of the 
forms aux:i.set:T, aux:7.set:F and aux:i.get, and the two basic instructions 
out.set:T and out.set:F. Moreover, there are k different jump instructions 
that may occur and one termination instruction. This means that there are 
3(n + 3(k —1)+2)+k+1 = 3n+4+ 10k —2 different primitive instructions that 
may occur in these instruction sequences. Hence, the number of instruction 
sequences concerned is not greater than (3n + 10k — 2)*. 


Theorem 1 states that all n-ary Boolean functions can be computed 
by an instruction sequence from ISp,; whose length is exponential in n. The 
following theorem shows that, for large enough n, not all n-ary Boolean 
functions can be computed by an instruction sequence from IS,, whose 
length is polynomial in n. 
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Theorem 3 For eachn € N with n > 11, there exists a n-ary Boolean func- 
tion f :B" + B such that, for each X € ISp, that computes f, length(X) > 


[2"/n}. 


Proof: Let n€N be such that n > 11. By Proposition 1 and the remarks 
immediately preceding Proposition 1, the number of n-ary Boolean functions 
that can be computed by instruction sequences from ISp, of length less 
than or equal to k is not greater than (3n + 10k — 2)*. For k = |2”/n\], 
this number is not greater than (3n + 10|2”/n| — 2)2"/"]. We have that 
(nb 16(27 Jn | =e Ba On) = 2) = CI aye 
(11/n)?"/" . (2”)2"/" — (11/n)?"/" . 22") < 22"), Here, we have used the 
given that n > 11 in the second step and the last step. So there exist less 
than 22") n-ary Boolean functions that can be computed by instruction 
sequences from IS}, of length less than or equal to |2”/n]|, whereas there 
exist 22”) n-ary Boolean functions. Hence, there exists an n-ary Boolean 
function that cannot be computed by an instruction sequence from ISp; of 
length less than or equal to |2"/n|. 


Theorem 3 gives rise to the following corollary concerning IS;,\poly. 
Corollary 3 [S},\poly C ISp,\O(2”). 


Theorem 3 will be used in the proof of the following hierarchy theorem 
for ISp,\poly. 


Theorem 4 For each k €N, ISp,\O(n*) Cc ISp,\O(n**?). 


Proof: — Let (fn)nex be a Boolean function family such that, for each 
n > 11, for each X € IS, that computes f,, length(X) > |[2"/n|]. 
Such a Boolean function family exists by Theorem 3. Let k& € N, 
and let (gn)nen be the Boolean function family such that, for each 
ING Bi 5s 25 Ue, eS Diy eee AE Op. OP and G(be, cote) = 
Flog ((k+2)nk+1)] (Wigas 1 Drog((k+2)nk+1)]) if n = oR Then (9n) nen € 
IS,,\O(n**1) by Theorem 1. Moreover, for each n > 2**3, for each Y € ISp, 
that computes gn, length(Y) > [2!es((k+2)n"*")] /floe((k + 2)nk+1)]| > 
[2los((k+2)n") /(log((k + 2)nk+1) + 1)| > [(k + 2)n!+1/(ke + 2) log(n)| = 
|nk+! /log(n)|. Here, we have used the given that n > 2'*? in the last 
step but one. From the fact that, for all m © N, there exists an n € N 
such that n > mlog(n), it follows that not |n**1/log(n)| = O(n*). Hence, 
(In) nen ¢ TSp,\O(n*). 


As a corollary of the general definition of the non-uniform complexity 
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classes IS\F, the fact that poly = Uzen {h | hh: N+ NA h(n) = O(n*)}, 
and Theorem 4, we have the following result. 


Corollary 4 For each k € N, ISp,\poly Z 1Sp,\O(n*). 


6 Instruction Sequences, Boolean Formulas and 
Circuits 


In this section, we investigate connections of single-pass instruction sequences 
with Boolean formulas and Boolean circuits which are relevant to non-uniform 
complexity and show that IS},\poly coincides with P/poly. The definitions 
of Boolean circuits, P/poly and related notions on which some results in this 
section and the coming ones are based are the definitions from Chapter 6 
of [1]. 

First, we dwell on obtaining instruction sequences that compute the 
Boolean functions induced by Boolean formulas from the Boolean formulas 
concerned. 

Hereafter, we will write $(b1,...,b,), where ¢ is a Boolean formula 
containing the variables v1,...,U, and 0),...,b, € B, to indicate that ¢ is 
satisfied by the assignment o to the variables v1,..., Uy, defined by o(v1) = 61, 

£80) = Dp: 


Let ¢ be a Boolean formula containing the variables v1,...,Un. Then 
the Boolean function induced by @ is the n-ary Boolean function f defined 
by f(b, . nee) =T iff o(b1, cee 5 On): 

The Boolean function induced by a CNF-formula can be computed, 
without using auxiliary Boolean registers, by an instruction sequence that 
contains no other jump instructions than #2 and whose length is linear in 
the size of the CNF-formula. 


Proposition 2 For each CNF-formula ¢, there exists an X € ISP. in which 
no other jump instruction than #2 occurs such that X computes the Boolean 
function induced by ¢ and length(X) is linear in the size of ¢. 


Proof: — Let inseqg,¢ be the function from the set of all CNF-formulas 
containing the variables v1,...,U, to isha defined as follows: 
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insedeng (A ieft mn] V jet na] &ij) = 


inseq’..¢(€11) 3... 3 mseg i r(E1n,) ; +out.set:F ; #2 ; |; 
inseq’ (Emi) 3+» +3 INsed.ne(Emnm) 3 Fout.set:F ; #2 ;!;+0ut.set:T;!, 
where 


inseq.¢(Uk) = +in:k.get ; #2, 
inseq.¢(—7 Un) = —in:k.get ; #2 . 


It is easy to see that no other jump instruction than #2 occurs in inseqey¢(). 
Recall that a disjunction is satisfied if one of its disjuncts is satisfied and a 
conjunction is satisfied if each of its conjuncts is satisfied. Using these facts, 
it is easy to prove by induction on the number of clauses in a CNF-formula, 
and in the basis step by induction on the number of literals in a clause, that 
inseden¢(@) computes the Boolean function induced by ¢. Moreover, it is 
easy to see that length(inseq.,¢(@)) is linear in the size of ¢. 


In the proof of Proposition 2, it is shown that the Boolean function in- 
duced by a CNF-formula can be computed, without using auxiliary Boolean 
registers, by an instruction sequence that contains no other jump instruc- 
tions than #2. However, the instruction sequence concerned contains the 
termination instruction more than once and both out.set:T and out.set:F. 
This raises the question whether further restrictions are possible. We have a 
negative result. 


Proposition 3 Let ¢ be the Boolean formula vy A v2 A v3. Then there does 
not exist an X € rhs in which the termination instruction does not occur 
more than once and the basic instruction out.set:F does not occur such that 
X computes the Boolean function induced by @. 


Proof: Suppose that X = u,;...;u,z is an instruction sequence from ihe 
satisfying the restrictions and computing the Boolean function induced by @. 
Consider the smallest | € [1,k] such that u; is either out.set:T, --out.set:T 
or —out.set:T (there must be such an 1). Because ¢ is not satisfied by all 
assignments to the variables v1, v2, v3, it cannot be the case that | = 1. In 
the case where | > 1, for each 7 € [1,1 — 1], u; is either in:7.get, +in:j.get or 
—in:j.get for some j € {1, 2,3}. This implies that, for each i € [0,/—1], there 
exists a basic Boolean formula 7; over the variables v1, v2, v3 that is unique up 
to logical equivalence such that, for each b,, b2, b3 € B, if the initial states of 
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the Boolean registers named in:1, in:2 and in:3 are b;, bg and bs, respectively, 
then uj41 will be executed iff 7;(b1, b2, bz). We have that wo <= T and, for 
each 7 € [Lg -_ 1], Wi = (Wi-1 > T) if u; = in:j.get, yj; = (wy-1 => v;) if 
ui = +in:j.get, and yj & (Wi-1 > 7 v;) if uj = —in:j.get. Hence, for each 
i € [0,—1], y% => ¢ implies T > ¢ orv; > ¢orv; > ¢ for some 
j € {1,2,3}. Because the latter three Boolean formulas are no tautologies, 
vw; => ¢ is no tautology either. This means that, for each 7 € [1,1 — 1], 
yw; => @ is not satisfied by all assignments to the variables v1, v2, v3. Hence, 
X cannot exist. 


According to Proposition 2, the Boolean function induced by a CNF- 
formula can be computed, without using auxiliary Boolean registers, by an 
instruction sequence that contains no other jump instructions than #2 and 
whose length is linear in the size of the formula. If we permit arbitrary jump 
instructions, this result generalizes from CNF-formulas to arbitrary basic 
Boolean formulas, i.e. Boolean formulas in which no other connectives than 
a, V and A occur. 


Proposition 4 For each basic Boolean formula ¢, there exists an X € Isp. 
in which the basic instruction out.set:F does not occur such that X computes 
the Boolean function induced by ¢ and length(X) is linear in the size of ¢. 


Proof: Let inseqy, be the function from the set of all basic Boolean 
formulas containing the variables v1,..., Un to 1S? defined as follows: 


insegqye(d) = insegi,(@) ; tout.set:T ;! , 


where 
insegie(Up) = +in:k.get , 
insegie(— ?) = inseqye() #2, 
insegie(d V W) = insegie(d) ; #length(inseg).(w))+1 ; insegye(W) , 
insegie(@ A W) = insegie(d) 3 #2; #length(inseg),,-(w))+2 ; insegy,(W) 


Using the same facts about disjunctions and conjunctions as in the proof 
of Proposition 2, it is easy to prove by induction on the structure of ¢ that 
inseqye(P) computes the Boolean function induced by ¢. Moreover, it is easy 
to see that length(inseq,¢(@)) is linear in the size of ¢. 


In the next proposition, we consider Boolean circuits instead of Boolean 
formulas. 
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Let C be a Boolean circuit with n input nodes and a single output node. 
Then the Boolean function induced by C' is the n-ary Boolean function f 
defined by f(b1,...,0n) = C(b1,...,6n), where C(b1,...,b,) denotes the 
output of C on input (b1,..., bn). 

Because Boolean formulas can be looked upon as Boolean circuits with 
a single output node in which all gates have out-degree 1, the question arises 
whether Proposition 4 generalizes from Boolean formulas to Boolean circuits 
with a single output node. This question can be answered in the affirmative 
if we permit the use of auxiliary Boolean registers. 


Proposition 5 For each Boolean circuit C with a single output node that 
contains no other gates than — -gates, V-gates and /-gates, there exists an 
X €[Sp, in which the basic instruction out.set:F does not occur such that X 
computes the Boolean function induced by C and length(X) is linear in the 
size of C. 


Proof: Let inseq,, be the function from the set of all Boolean circuits 
with input nodes in,,..., inn, gates 91,..., Gm and a single output node out 
to Is. defined as follows: 


inseqy.(C) = inseqy,.(g1) 3--- 3 inseg),.(Gm) ; taux:m.get ; +out.set:T ;! , 
where 


inseqy.(9k) = 
insegy, .(p) ; #2 ; taux:k.set:T 
if g, is a a-gate with direct preceding node p , 
insedi.(9k) = 
inseq}, .(p) ; #2; inseq}.(p’) ; +aux:k.set:T 
if g, is a V-gate with direct preceding nodes p and p’ , 
inseqy.(9k) = 
inseq}, .(p) ; #2 ; #3; inseg).(p’) ; +aux:k.set:T 
if gx is a A-gate with direct preceding nodes p and p’ , 
and 
inseq}, (ink) = +in:k.get , 
inseq}, (9x) = +aux:k.get . 
Using the same facts about disjunctions and conjunctions as in the proofs 
of Propositions 2 and 4, it is easy to prove by induction on the depth of C 
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that inseq,.(C) computes the Boolean function induced by C if g1,..., 9m 
is a topological sorting of the gates of C. Moreover, it is easy to see that 
length(inseq,,(C)) is linear in the size of C. 


ISpr\poly includes Boolean function families that correspond to 
uncomputable functions from B* to B. Take an undecidable set N C N 
and consider the Boolean function family (fn),cnj with, for each n € N, 
fn: B” — B defined by 


fa(bi,-..,on) =TifneNn, 


For each n € N, fr, is computed by the instruction sequence out.set:T ; !. 
For each n ¢ N, f, is computed by the instruction sequence out.set:F ; !. 
The length of these instruction sequences is constant in n. Hence, (fn) ,en 
is in ISpr\poly. However, the corresponding function f : B* — B is clearly 
uncomputable. This reminds of the fact that P/poly includes uncomputable 
functions from B* to B. 

It happens that IS,,\poly and P/poly coincide, provided that we identify 
each Boolean function family (fn),cny with the unique function f : B* > B 
such that for each n € N, for each w € B”, f(w) = fn(w). 


Theorem 5 [5S,,\poly = P/poly. 


Proof: We will prove the inclusion P/poly C IS},\poly using the definition 
of P/poly in terms of Boolean circuits and we will prove the inclusion 
ISpr\poly C P/poly using the characterization of P/poly in terms of Turing 
machines that take advice (see e.g. Chapter 6 of [1]). 

P/poly € ISp,\poly: Suppose that (fp),cy in P/poly. Then, for all 
n EN, there exists a Boolean circuit C such that C computes f, and the 
size of C is polynomial in n. For each n € N, let Cy, be such a C. From 
Proposition 5 and the fact that linear in the size of C, implies polynomial in 
n, it follows that each Boolean function family in P/poly is also in ISp,\poly. 

ISpr\poly C P/poly: Suppose that (fn),cy in ISp,\poly. Then, for all 
n EN, there exists an X € IS, such that X computes f, and length(X) 
is polynomial in n. For each n € N, let X,, be such an X. Then f can be 
computed by a Turing machine that, on an input of size n, takes a binary 
description of X, as advice and then just simulates the execution of Xy. 
It is easy to see that under the assumption that X, € isnot, where 
k = length(X,,), the size of the description of X, and the number of steps 
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that it takes to simulate the execution of X, are both polynomial in n. 
We can make this assumption without loss of generality (see the remarks 
immediately preceding Proposition 1). Hence, each Boolean function family 
in ISpr\poly is also in P/poly. 


It is unknown to us whether IS \poly is different from IS;,,\poly for all 
k € N (see also Section 11). 


7 The Non-uniform Super-polynomial Complex- 
ity Conjecture 


In this section, we formulate a complexity conjecture which is a counterpart 
of the well-known complexity theoretic conjecture that NP Z P/poly in the 
current setting. The definitions of NP, NP-hardness, NP-completeness and 
related notions on which some results in this section and the coming ones 
are based are the ones from Chapter 2 of [1]. 

The counterpart of the conjecture that NP Z P/poly formulated in 
this section corresponds to the conjecture that 3SAT ¢ P/poly. By the 
NP-completeness of 3SAT, 3SAT ¢ P/poly is equivalent to NP Z P/poly. If 
the conjecture that NP Z P/poly is right, then the conjecture that NP 4 P 
is right as well. 

To formulate the conjecture, we need a Boolean function family 
(3SAT’,),,cn that corresponds to 3SAT. We obtain this Boolean function 
family by encoding 3CNF-formulas as sequences of Boolean values. 

We write H(k) for er) + ea a ys H(k) is the number of combi- 
nations of at most 3 elements from a set with 2k elements. Notice that 
H(k) = (4k? + 5k)/3. 

It is assumed that a countably infinite set {v1, v2,...} of propositional 
variables has been given. Moreover, it is assumed that a family of bijections 


(ag : (1, 4(k)] > {LC {01,7 u1,..., Up, 7 UE} | 1 < card(L) < 3}) pen 
has been given that satisfies the following two conditions: 


Vi EN+Vj € [1, H(i)] © as (ais (J)) =, 


a is polynomial-time computable , 


° As usual, we write (*) for the number of l-element subsets of a k-element set. 
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where a: Nt > {LC {v1,7 1, v2, 7 v2,...} | 1 < card(L) < 3} is de- 
fined by 
a(t) = Oninfjien AG @ - 
The function a is well-defined owing to the first condition on (ax),en- The 
second condition is satisfiable, but it is not satisfied by all (ax), cy Satisfying 
the first condition. 
The basic idea underlying the encoding of 3CNF-formulas as sequences 
of Boolean values is as follows: 
e ifn = H(k) for some k € N, then the input of 3SAT’, consists of one 
Boolean value for each disjunction of at most three literals from the 
set {01,7 U1,---, Ug, 7 Ug}; 


e each Boolean value indicates whether the corresponding disjunction 
occurs in the encoded 3CNF-formula; 


e if H(k) < n < H(k +1) for some k € N, then only the first H(k) 
Boolean values form part of the encoding. 


For each n € N, 3SAT/, : B” — B is defined as follows: 
e ifn = H(k) for some k € N: 


SSAT Abijetc§ bg = Tie /\ VV a,(i) is satisfiable , 
i€[1,n] s.t. bj =T 


where k is such that n = H(k); 
e if H(k) <n < H(k+1) for some k €N: 
3SATY,(b1,...,5n) = 39AT xq (b1, ---Be()) > 
where & is such that H(k) <n < H(k +1). 


Because (a%),cn satisfies the condition that a;~'(ai+1(9 


)) = 9 for all 
i € N and j € [1, H()], we have for each n €N, for all b1,...,6 


EB: 


) 


3SAT", (b1,...,bn) = 3SAT’, 4 4(b1,..-,bnsF) . 


In other words, for each n € N, 3SAT/,,; can in essence handle all inputs that 
3SAT’ can handle. We will come back to this phenomenon in Section 10. 

3SAT’ is meant to correspond to 3SAT. Therefore, the following theorem 
does not come as a surprise. We identify in this theorem the Boolean function 
family 35AT’ = (3SAT",),, cy with the unique function 3SAT’ : B* > B such 
that for each n € N, for each w € B”, 3SAT’(w) = 3SAT/ (w). 
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Theorem 6 3SAT’ is NP-complete. 


Proof: 3SAT’ is NP-complete iff 3SAT’ is in NP and 3SAT’ is NP- 
hard. Because 3SAT is NP-complete, it is sufficient to prove that 3SAT’ 
is polynomial-time Karp reducible to 3SAT and 3SAT is polynomial-time 
Karp reducible to 3SAT’, respectively. In the rest of the proof, a is defined 
as above. 

3SAT’ is polynomial-time Karp reducible to 3SAT: Take the func- 
tion f from B* to the set of all 3CNF-formulas containing the vari- 
ables v1,...,0,% for some k € N that is defined by f(b1,...,bn) = 
Nie tt max{ H(k)|H(k)<n}] st. b:-t V o(2). We have that BOAT (Bit e2sg Dg) = 
3SAT(f(b1,...,6n)). It remains to show that f is polynomial-time com- 
putable. To compute f(bi,...,0n), @ has to be computed for a number of 
times that is not greater than n and a is computable in time polynomial 
in n. Hence, f is polynomial-time computable. 

3SAT is polynomial-time Karp reducible to 3SAT’: Take the unique func- 
tion g from the set of all 3CNF-formulas containing the variables v1,..., uz 
for some k € N to B* such that for all 3CNF-formulas ¢ containing SHE 
variables v1,..., vz for some k € N, f(g(¢)) = ¢ and there exists no w € 
shorter than 4(4) such that f(w) = ¢. We have that 3SAT(¢) = 3SAT’(g(¢)). 
It remains to show that g is polynomial-time computable. Let / be the size 
of ¢. To compute g(¢), a has to be computed for each clause a number of 
times that is not greater than H(l) and a is computable in time polynomial 
in H(l). Moreover, ¢ contains at most / clauses. Hence, g is polynomial-time 


computable. 


Before we turn to the non-uniform super-polynomial complexity con- 
jecture, we touch lightly on the choice of the family of bijections in the 
definition of 3SAT’. It is easy to see that the choice is not essential. Let 
3SAT” be the same as 3SAT’, but based on another family of bijections, 
say (Q/,) ncn» and let, for each i € N, for each j € [1, H(2)], bi = be,-1(a4(5))+ 
Then: 


e ifn = H(k) for some k € N: 
SSAT. (Oise On) = 3SAT;, (Oj 0) * 
e if H(k) <n < H(k+1) for some k EN: 
SSAT, (bi; aayby) SBSAT1 Oly eas agysbuny eave bas 
where & is such that H(k) <n < H(k +1). 
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This means that the only effect of another family of bijections is another 
order of the relevant arguments. 

The non-uniform super-polynomial complexity conjecture is the following 
conjecture: 


Conjecture 1 3SAT’ ¢ IS},\poly. 


3SAT’ ¢ IS,,\poly expresses in short that there does not exist a poly- 
nomial function h: N —- N such that for all n € N there exists an X € IS), 
such that X computes 3SAT/, and length(X) < h(n). This corresponds 
with the following informal formulation of the non-uniform super-polynomial 
complexity conjecture: 


the lengths of the shortest instruction sequences that compute 
the Boolean functions 3SAT/, are not bounded by a polynomial 
in n. 


The statement that Conjecture 1 is a counterpart of the conjecture that 
3SAT ¢ P/poly is made rigorous in the following theorem. 
Theorem 7 3SAT"’ ¢ IS,\poly iff 3SAT ¢ P/poly. 


Proof: This follows immediately from Theorems 5 and 6 and the fact 
that 3SAT is NP-complete. 


8 The Complexity Classes [S\\F 


In this section, we introduce a kind of non-uniform complexity classes which 
includes a counterpart of the complexity class NP/poly in the setting of 
single-pass instruction sequences and show that this counterpart coincides 
with NP/poly. Some results in this section are based on the definition of 
NP in terms of P, which can for example be found in [1] (and which uses 
the idea of checking certificates), and the general definition of non-uniform 
complexity classes C/F’, which can for example be found in [3] (and which 
uses the idea of taking advice). 

Let IS C ISp, and let F C {h| h: NN}. Then JS\\F is the class of 
all Boolean function families (fn),cy that satisfy: 


there exist a monotonic h € F and a Boolean function family 
(In)nen € IS\F such that, for all n € N, for all w € B”: 


fn(w) =T = a¢¢ Brin) * In+h(n)(W c) = 
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If ac ¢ B* and aw € B” for which f,(w) =T satisfy gn4n(n)(w ec) = T, then 
we call c a certificate for w. 

In the sequel, the monotonicity requirement in the definition given 
above is only used to show that ISp,\\poly coincides with NP/poly (see 
Theorems 11 and 12). 

For each IS C ISp, and F C {h|h: NN}, the connection between 
the complexity classes [S\F' and [S'\\F is like the connection between the 
complexity classes P and NP in the sense that it concerns the difference in 
complexity between finding a valid solution and checking whether a given 
solution is valid. 

We are primarily interested in the complexity class IS,;\\poly,’ but we 
will also pay attention to other instantiations of the general definition just 
given. 

We have that IS},\poly is included in IS,,\\poly. 


Theorem 8 [5,,\poly C I5S,,\\poly. 


Proof: Suppose that (fn),cj € ISpr\poly. Then, for all n €N, for all 
w € B": 


fr(w) =T Ace Bm. Fntn(n) (w c) = 


for the monotonic h € poly defined by h(n) = 0 for all n € N, because the 
empty sequence can be taken as certificate for all w. 


Henceforth, we will use the notation [S\\O(f(n)) for the complexity 
class IS\\ {h | h:N > NA h(n) = O(f(n))}. This notation is among other 
things used in the following corollary of the proof of Theorem 8. 


Corollary 5 For each k € N, IS}:\O(n*) C IS},\\O(n*). 


Henceforth, we will use the notation JS\\B(f(n)) for the complexity 
class [9\\ {h | h: N+4NAVn € Nt h(n) < f(n)}. This notation is among 
other things used in the following theorem about the complexity class 


ISpr\O(n*). 
Theorem 9 For each k EN, ISp,\\O(n*) C Upen+ Spr\B(an*). 


Proof: Let k € N. It isa direct consequence of the definition of IS,,\\O(n*) 
that, for all Boolean function families (fn) nen, (fn)nen € ISpr\\O(n*) implies 


"In precursors of this paper, the temporary name P** is used for the complexity class 
ISpr\\poly (see e.g. [7]). 
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that there exists an a € Nt such that (fn)ncy € ISpr\B(an*). Hence 
TSpr\\O(n*) © Usen+ Spr\B(an*). 


In the proof of the following hierarchy theorem for IS},\\poly, we will 
use the notation [S'\,F for {f :B” > B | A(gn) nen € IS\F * f = gn}. 


Theorem 10 For each k € N, IS},\\O(n*) c ISpr\O(n*? +3), 


Proof: We will prove this theorem by defining a Boolean function family 
that by definition does not belong to IS},\\O(n*) and showing that it does 
belong to IS},\\O(n**+). The definition concerned makes use of a natural 
number mg and an m,-ary Boolean function g, for each positive natural 
number a. These auxiliaries are defined first, using additional auxiliaries. 
Let k EN. 

For each a € N*, let the function H,:N — N be defined by H,(n) = 
(3n+10a(n+an*)k—2)4"+an*)" | By Proposition 1, the remarks immediately 
preceding Proposition 1 and the definition of IS,,\\B(an*), we have that, 
for each a € Nt, the number of n-ary Boolean functions that belong to 
ISpr\\nB(an*) is not greater than Ha(n) if n > 0. So |ISp,\nBlan*)| < 
H,(n) if n > 0. By simple arithmetical calculations we find that H,(n) < 
(12(a+ LPH Lp R)) (at 1) tI) < 9A(at1 hn Hse n > 0. Hence H,(n) < 
gn +? itn > 4(a + 1)?+)_ By simple arithmetical calculations we also 
find that (4(a + 1)2#+1))#?+2 — 9(k?+2)(2(K+1) log(at+1)+og(4)) and that (k2 + 
2)(2(k +1) log(a+1)+log(4)) < 2(k?+2)(k+1)(a+1) < 4(a+1)?+), Hence 
nk’+2 < 9" ifn > A(a+1)?4*), For each a € Nt, let mq = 4(a + 1)?4*Y), 
We immediately have that, for all a € Nt, mg < may, and, for all n > ma, 
A (ay = gn? and nk?t2 +1< 2". 

For each a € N*, let Sy € (Bra )mah be such that the elements 
of S, are mutually different, and let Sa be the set of all elements of Sq. 
Because Mak +? +1 < 24, we have that S, C B+. The number of 
functions from Sa to Bis gma 241 and we have that gia #241 > Hgling) = 
[ISpr\\m,B(ama")|. Because each function f’ : S, > B can be extended to 
a function f : B’* — B by defining f(w) = f’(w) if w € Sq and Flo) =F 
otherwise, this means that there exists an m,-ary Boolean function that 
does not belong to ISp;\\m, B(a Ma"). For each a € NT, let gq be such an 
Mg-ary Boolean function. 


Let (9n),en be the Boolean function family such that, for each n € N, 
gn is defined as follows: 
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e if m = mq for some a € N*: gn = ga, where a is such that n = mq; 


e ifn Amz, for all aE Nt: gp(w) =F for all w € B”. 


For each a € N*, there exists an n € N* such that g, does not belong to 
TSpr\nB(an*). Hence, by Theorem 9, (gn) new ¢ ISpr\\O(n*). 

For each n € N, we can construct an instruction sequence X that 
computes gy as follows: 


e ifm =m, for some a € Nt: X = X91), |, Xe 42 1 O42 41) | 
where for each i € [1,n***? + 1], w; is the ith element of S, (where a 
is such that n = mq), and X“” is an instruction sequence that sets 
the output register to 6 if all input registers together contain w and 
jumps to the next instruction sequence otherwise; 


e ifn Ama, for alae Nt: X =!. 


In the case where n = mq for some a € N*, length(X) < (nk?+2 41) -(2n+1) 
+1. Otherwise, length(X) = 1. Hence, (gn) nen € ISpr\O(n** +3), From this 
and Corollary 5, it follows that (gn),cn € ISpr\O(n** +3), 


The approach followed in the proof of the hierarchy theorem for ISp,;\poly 
does not seem to work for the proof of the hierarchy theorem for ISp,\\poly. 
In the general definition of the complexity classes [S'\ F’, a pair of an 
input and a certificate is turned into a single sequence by simply concatenat- 
ing the input and the certificate. In the usual definition of NP in terms of P, 
on the other hand, a pair of an input and a certificate is uniquely encoded 
by a single sequence from which the input and certificate are recoverable. A 
function that does so is commonly called a pairing function. In the case of 
ISpr\\poly, a definition in which a pair of an input and a certificate is turned 
into a single sequence in the latter way could have been given as well. 
Consider the pairing function from B* x B* to B* that converts each two 
sequences (bi,..., bp) and (b4,...,0/,,) into (b1, b1,..., bn, bn, T,F, b4,..., by). 
Henceforth, we will write w-w’, where w,w’ € B*, to denote the result of 
applying this pairing function to w and w’. Take, for each m € N, the function 
from |), B’ to B* that converts each sequence (b1,...,0m;bm+1,---;0n) 
into (b1,...,bm) -(bm+1,---,6n), and the two projection functions from the 
range of the above-mentioned pairing function to B* that extract from 
each sequence (b),...,0m) + (bm+41,---,0n) the sequences (b1,..., 0m) and 
(bm+i,---,bn). Then, for all n € N, the restrictions of these functions to 
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the sequences that belong to B” are computable by an instruction sequence 
X €IS8?. with length(X) = O(n). 
The following theorem gives an alternative characterization of IS,,\\poly. 


Theorem 11 Let (fn)necn be a Boolean function family. Then we have that 
(fn) nen € ISpr\\poly iff 


there exist an h € poly and a Boolean function family (9n) nen € 
ISpr\poly such that, for alln EN, for all w € B”: 


fn(w) = T @ Jc € BY (lel < A(n) A gw.ei(w +) =T) - 


Proof: The implication from left to right follows directly from the 
definition of IS,,\\poly and the remark made above about the projection 
functions associated with the pairing function used here. 

The implication from right to left is proved as follows. Let (gn) nen € 
ISp,\poly be such that there exists an h € poly such that, for all n € N, 
for all w € B”, fr(w) = T & de © Be (|e| < h(n) A gyy.(w +c) = T). 
For each w € B*, let c, be a certificate for w. Suppose that (yn),cn, with 
Yn 1B” — B* for every n € N, is an infinite sequence of injective functions 
satisfying: (i) there exists a monotonic h € poly such that, for all n € N, 
for all w € B”, |Y¥n(cw)| = h(n), (ii) for all n € N, y,~! is computable by an 
instruction sequence X € IS? with length(X) = O(h(n)). Then there exists 
a monotonic h € poly such that, for all n € N, for all w € B”, yn(cw) € Bh(n) 
and there exists a (g/,),,cj € ISpr\poly such that, for all n € N, for all w € B”, 
Jlw-c|(W* Cw) = T Gnth(n) (wYn(cw)) = T. The existence of a suitable 


(n)nen € ISpr\poly is not guaranteed for an h € poly with the property 
that there exist n,n’ € N such that n+ h(n) =n’ +h(n’) and n 4 n’, but 
this property is excluded by the required monotonicity of h. It remains 
to show that the functions y, supposed above exist. For y,, we can pick 
the function that converts each sequence (b1,...,bn) into (b1,b),.--,bn,8I,), 
where b, = T if i # n and U/, = F, and adds at the end of the converted 
sequence sufficiently many F’s to obtain results of the required length. 


It happens that IS,,\\poly and NP/poly coincide, provided that we 
identify each Boolean function family (fn),cxj with the unique function 
f : B* > B such that for each n € N, for each w € B”, f(w) = fn(w). 


Theorem 12 I[5,,\\poly = NP/poly. 
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Proof: — It follows by elementary reasoning from the general definition of 
non-uniform complexity classes C/F' and the definition of NP in terms of 
P that f € NP/poly iff there east: a poleome function h:N—> N anda 
g € P/poly such that, for all w € 


f(w) =T Ac € B*e (c] < h(|w]) Ag(w-c) =T) 


(cf. Fact 2 in [25]). From this characterization of NP/poly and the 
characterization of IS,,\\poly given in Theorem 11, it follows easily that 
ISpr\\poly = NP/poly. 


In Section 7, we have conjectured that 3SAT’ ¢ IS,,\poly. The question 
arises whether 3SAT’ € IS},\\poly. This question can be answered in the 
affirmative. 


Theorem 13 3SAT” € IS;,\\poly. 


Proof: 3SAT’ € NP by Theorem 6, NP C NP/poly by the gen- 
eral definition of non-uniform complexity classes C/F (see e.g. [3]), and 
NP/poly = IS;,\\poly by Theorem 12. Hence, 3SAT’ € IS;,\\poly. 


9 Completeness for the Complexity Classes /S\\F 


In this section, we introduce the notion of [S\\F-completeness, a general 
notion of completeness for complexity classes [S\\F' where F is closed under 
function composition. Like NP-completeness, [S'\\F'-completeness will be 
defined in terms of a reducibility relation. 

Let IS C Spr, let 1, m,n € N, and let f:B” —> B and g:B” > B. Then f 
is l-length IS-reducible to g, written f er g, if there exist hj,...,hm:B” > B 
such that: 


e there exist X1,...,Xm € IS such that Xj,..., Xm, compute hy,..., Ahm 
and length(X1),...,length(Xm) < 1; 


e for all bi,...,b, € B, Tl bisa Da) = Oi ices <4 Ua ancrg log Digaass 
Bn). 


Let IS C ISp,, let F C {h| h:N—N} be such that F is closed under 
function composition, and let (fn)nexj and (gn)nen be Boolean function 
families. Then (fn),en is non-uniform F-length IS-reducible to (gn) 
written (fn)nen <2 (9n)nen> if there exists an h € F such that: 


neN? 


Instruction Sequence Based Non-uniform Complexity Classes 79 


e foralln EN, there exist 1,m € N with 1,m < h(n) such that fn ae Jm- 


Let IS C ISp,, let F be as above, and let (fn),cx be a Boolean function 
family. Then (fn) en is 1S\\F-complete if: 


. (fn) nen eis \F; 


e for all (9n) nen e IS\\F, (In) nen <P (fn) nen: 


The most important properties of non-uniform F’-length [S-reducibility 
and [S'\\F-completeness as defined above are stated in the following two 
propositions. 


Proposition 6 Let IS CISp,, and let F be as above. Then: 


1. af (fn) nen <P (9n) nen and (9n) nen € IS\F, then (fn) nen € IS\F; 


2. <9 is reflexive and transitive. 


Proof: Both properties follow immediately from the definition of So ‘ 


Proposition 7 Let IS CISp,, and let F be as above. Then: 
1. if (fn)nen 18 IS\\F-complete and (fn)nen € IS\F, then IS\ F = IS\F; 


2. if (fndnen 18 IS\\F-complete, (gn)nen € IS\F and (fa)nen ae 
(9n)nen> then (Gn) nen 18 1S\\F-complete. 


Proof: The first property follows immediately from the definition of 
IS'\\F-completeness, and the second property follows immediately from the 
definition of [$\\F-completeness and the transitivity of <1. 


The properties stated in Proposition 7 make [S'\\ F'-completeness as defined 
above adequate for our purposes. In the following proposition, non-uniform 
polynomial-length IS},-reducibility (<'Se: ) is related to polynomial-time 


—poly 
Karp reducibility (< a) ° 


Proposition 8 Let (fn),ex and (9n)ncn be Boolean function families, and 
let f and g be the unique functions f,g:B* > B such that for eachn EN, 


for each w € B”, f(w) = fn(w) and g(w) = gn(w). Then f ey g only if 


ISpr 
(fn) nen ly (9n) nen: 


For a definition of polynomial-time Karp reducibility, see e.g. Chapter 2 of [1]. 
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Proof: This property follows immediately from the definitions of ae 


and ae the fact that P C P/poly (which follows directly from the general 


definition of non-uniform complexity classes C/F), and Theorem 5. 


The property stated in Proposition 8 allows for results concerning polynomial- 
time Karp reducibility to be reused when dealing with non-uniform 
polynomial-length IS,,-reducibility. 

We would like to call IS},\\poly-completeness the counterpart of 
NP/poly-completeness in the current setting, but the notion of NP/poly- 
completeness looks to be absent in the literature on complexity theory. The 
closest to NP/poly-completeness that we could find is p-completeness for 
pD, a notion introduced in [22]. 

Because 3SAT’ is closely related to 3SAT and 3SAT” € IS;,\\poly, we 
expect 3SAT’ to be IS},\\poly-complete. 


Theorem 14 3SAT"” is IS},\\poly-complete. 


Proof: By Theorem 13, we have that 3SAT’ € IS),\\poly. It remains to 
prove that for all (fn) nen € ISpr\\poly, (fn) nen Spat, 3SAT’. 

Suppose that (fn)nen € ISpr\\poly. Let (gn) ,en € ISpr\poly be such 
that there exists a monotonic h € poly such that, for each n € N, for each 
w € B, fr(w) =T & Jc Ee BY). In+h(n)(w ec) = T. Such a (Gn) neq exists 
by the definition of IS,,\\poly. Let h € poly be such that, for each n € N, for 
each w € B”, f,(w) =T © dc € Bh) *In+h(n)(we) = T. Let n EN, and 
let m= h(n). Let X € ISp, be such that X computes gn+m and length(X) 
is polynomial in n + m. 

Assume that out.set:T occurs only once in X, that #/ does not occur 
in X at positions where there is no /th next primitive instruction, and that 
test instructions do not occur in X at the last but one or last position. 
These assumptions can be made without loss of generality: by Theorem 2 
we may assume without loss of generality that out.set:F does not occur in 
X and therefore multiple occurrences of out.set:T can always be eliminated 
by replacing them with the exception of the last one by jump instructions, 
occurrences of #1 at positions where there is no /th next primitive instruction 
can always be eliminated by replacing them by #0, and occurrences of test 
instructions at the last but one or last position can be eliminated by adding 


once or twice #0 at the end. Suppose that X = u,;...; ux, and let I € [1, k] 
be such that wu; is either out.set:T, -+-out.set:T or —out.set:T. 
First of all, we look for a transformation that gives, for each b1,...,0n € 


B, a Boolean formula @p,,....p,, such that fp(b1,...,bn) = T iff do,,...,, is 


n 
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satisfiable. We have that fn(bi,...,6n) = T iff there exist initial states 
of the Boolean registers named in:n+1,...,in:n+-m for which there exists 
an execution path through X that reaches uw in case the initial states of 
the Boolean registers named in:1,...,in:n are b1,...,bn, respectively. This 
brings up the formula ¢@p,,..5,, given below. In this formula, propositional 
variables r1,...,?n+m and v1,...,v% are used. The truth value assigned to 
r; (i € [1,n + mJ) is intended to indicate whether the content of the input 
register named in:i is T and the truth value assigned to v; (j € [1,k]) is 
intended to indicate whether the primitive instruction u; is executed. 

For each b1,..., bn € B, let dp,,...5,, be Niet) yi AN vy A vA Ajetua Wj, 
where: for each 7 € [1,n], x; is 


eT; if b; = T; 
e — 7; if b} =F; 
for each j € [1,k], ~; is 


eu; > vj41 if uy =a; 


e Uj > Vj41 if uj; =+f.set:T or uj = —f.set:F; 
eu; > 7 741 Avj42 if uj = +f.set:F or uj = —f.set:T; 
@ (UAT, > Vj41) A (Uj AT TE > 7 U;41 A U7 42) if uj; = +inst.get; 
© (Uj; A7 TE > U541) A (UZ ATE > 7 Uj41 A 0542) if uy = —in:t.get; 
e (U3; AV. pi, vit N\ [\. i, Uy") > VU; /\ 

( 7 Virewict_,( iv Neath, i") +1) 


(v; /\ Virepit_, (U5! A Aires, < U5") => 7 Uj41 \ Uj 42) 


if u; = +aux:i.get; 
e (vu; A\V. iF uy Nf. ay a Uy") => Us41) A 
( J Virepit_ ( J Nines, o] ) T+ ) 


UNV ae pit (Ui A/\, i,F Uy) => 7 U541 A Vi+2 
( Virenit_,| : Neath, i) +2) 
if u; = —aux:i.get; 


enV; if u; = 70; 
eu; => Ajeitig-H—1 7 U5! A VU5+41 if Ujp= #land1l<Il<k—-gj; 


e OFikug =i 
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where a is the set of all j” € [7,7] for which uj is either aux:i.set:b, 
+aux:i.set:b or —aux:i.set:b. 


If there exist initial states of the Boolean registers named in:n+1, 
...,in:n-+m for which there exists an execution path through X that reaches 
uw in case the initial states of the Boolean registers named in:1,...,in:n are 
bi,...,bn, respectively, then @p,,.p,, is satisfiable by assigning truth values 
to the variables according to the intention mentioned above. On the other 
hand, if @p,,...p, 18 satisfiable, then a satisfying assignment indicates for 
which initial states of the Boolean registers named in:n+1,...,in:n++m there 
exists an execution path through X that reaches wu; and which instructions 
are on this execution path. Thus f,(b1,...,6n) = T iff p,,....0, is satisfiable. 


n 


l 


For some 1 €N, ¢p,,...,p, Still has to be transformed into a wp,,....b, € 
such that @p,....p, 18 satisfiable iff 38AT/(w»,....,,) = T. We look upon this 
transformation as a composition of two transformations: first @p,,.p, is 
transformed into a 3CNF-formula Wp, ,...p,, such that @p,,....b, is satisfiable iff 
Wpy,...,bn 18 Satisfiable, and next, for some 1 € N, wp, ,..p,, is transformed into 
& Wby,...,bn © B! such that Wb,,...bn 18 Satisfiable iff 3SAT)(wo,,....6,) = T- 


nm 


It is easy to see that the size of @p,,....p, is polynomial in n and that 
(b1,..., bn) can be transformed into ¢p, ..p,, in time polynomial in n. It is well- 
known that each Boolean formula ~ can be transformed in time polynomial 
in the size of ~ into a 3CNF-formula w’, with size and number of variables 
linear in the size of w, such that w is satisfiable iff 7’ is satisfiable (see e.g. 
Theorem 3.7 in [3]). Moreover, it is known from the proof of Theorem 6 that 
every 3CNF-formula ¢ can be transformed in time polynomial in the size 
of ¢ into a w € BY’), where k! is the number of variables in ¢, such that 
3SAT(¢) = 3SAT’(w). From these facts, and Proposition 8, it follows easily 
that (fn)nen is non-uniform polynomial-length IS,,-reducible to 3SAT’. 


The proof of Theorem 14 has been partly inspired by the proof of the 
NP-completeness of SAT in [14]. 


A known result about classical complexity classes turns out to be a 
corollary of Theorems 5, 6, 12 and 14. 


Corollary 6 NP Z P/poly iff NP/poly Z P/poly. 
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10 Projective Boolean Function Families 


In Section 7, we have noticed that, for each n € N, 3SAT/4, can 
in essence handle all inputs that 3SAT’, can handle because we have 
3SATI, (b1,---,0n) = 3SAT)41(b1,..-, bn, F). In this section, we come back 
to this phenomenon. 

For each m,n € N such that m > n, we define a projection function 
mm : (B™ > B) > (B” — B) as follows: 


n 


TOT Digs acs On) = Fists ds Une Pecado) 


for all f: B” > B and 04,..., bn € B. 

A projective Boolean function family is a Boolean function family 
(fn)nen Such that fp =a?" (fn41) for alln EN. 

This means that in the case where a Boolean function family (fn) ,cy 
is projective, for each m,n € N with m > n, fim can in essence handle all 
inputs that f, can handle. For that reason, complexity classes that are 
restricted to projective Boolean function families are potentially interesting. 

Let IS CIS, and F C {h| hh: NN}. Then /S\,F is the class of all 
projective Boolean function families (f,),cn that satisfy: 


there exists an h € F such that for all n € N there exists an 
X € IS such that X computes f,, and length(X) < h(n). 


Let JS C ISp, and let F C {h | h:N—-N}. Then JS\\,F is the class of 
all projective Boolean function families (fn),cy that satisfy: 


there exist a monotonic h € F and a Boolean function family 
(In)nen € 1S\rF such that, for all n € N, for all w € B”: 


fn(w) =T & Ace BY”. In+h(n) (we) =T. 


It follows immediately from the definitions concerned that [S\,F and 
IS\\,F are subsets of [S\F and IS'\\F, respectively. IS,,;\,;poly is a proper 
subset of IS,,\poly. This is easy to see. In Section 5, we gave an example of 
a Boolean function family corresponding to an uncomputable function from 
B* to B that belongs to IS,,\poly. The Boolean function family concerned is 
not a projective Boolean function family, and consequently does not belong 
to ISpr\,poly. 

The question arises whether the restriction to projective Boolean func- 
tion families is a severe restriction. We have that every Boolean function 
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family is non-uniform linear-length ISp,-reducible to a projective Boolean 
function family. 
Below, we will write lin for the set {h | h:N—> NA hislinear}. 


Theorem 15 Let (fn) cy be a Boolean function family. Then there exists a 
IS 
< br 


projective Boolean function family (gn) nen such that (fn) nen Sine” (On) nen: 


Proof: The idea is to convert inputs (b),...,b,) into (b1,04,...,bn,b),), 
where b, = T if i € n and bi, = F, because the converted inputs can be 
recovered after additions at the end. This conversion has been used before 
to prove Theorem 11. 

For each n € N, for each i € [1,n], let h5,_, : B’ > B be defined by 
hf _,(b1,...,6n) = by and let hf, : B” > B be defined by h§,(b1,...,6n) = T 
if i An and hj,(bj,...,b,) = Fifi =n. Clearly, these functions can be 
computed by instruction sequences from ISp, whose lengths are linear in 
n. Therefore, we are done with the proof if we show that there exists a 
projective Boolean function family (gn),,cj Such that for all n € N: 


fn(b1, sey bn) = gon (hi (b1, tees Dis), sey hg, (01, aay bn)) 7 


A witness is the projective Boolean function family (gn) ,,c with, for each n € 
N, gon: B?” — B defined by gan(b1, 1,---, On, 0,,) = fm(bi,..-,;bm), where m 
is the unique j € [1,n] such that bj = T for all 7 € [1,7 —1] and 0 = F if such 
an m exists and gon(b1,01,.--, bn, bi,) = F otherwise; and gon41:B?"t! > B 
defined by gon+1(b1, 64, ---, On; 0),,6) = gon(bi, 04,.--, On, Of). 


The following result is a corollary of Theorem 15 and the definitions of 
ISpr\poly and ISp,\,poly. 


Corollary 7 Let (fn)nen € Ipr\poly. Then there exists a (gn)nen © 
ISp,\rpoly such that (fn)nen Sain” (Yn) nen: 


11 Concluding Remarks 


We have presented an approach to non-uniform complexity which is based on 
the simple idea that each Boolean function can be computed by a single-pass 
instruction sequence that contains only instructions to read and write the 
contents of Boolean registers, forward jump instructions, and a termination 
instruction. 

We have answered various questions that arise from this approach, but 
many open questions remain. We mention: 
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We do not know whether Theorem 10 can be sharpened. In partic- 
ular, it is an open question whether, for each k € N, ISp,\\O(n*) c 
ISpr\O(n*+!), 


We know little about complexity classes [S\F where IS Cc ISp;. In 
particular, it is an open question whether: 


| 


ISP, \poly C ISp,\poly; 

— for each 1 EN, IS)*"\ poly c ISP \poly; 

— for each k € N, IS? \O(n*) c I8},\O(n*); 
— for each k,l € N, ISP\O(n*) c IS°\O(n*). 


Likewise, we know little about complexity classes [S\\F where IS Cc 
IS,,- It is also an open question whether: 


— IS?,\\poly C IS};\\poly; 

— for each 1 EN, IS):"\poly c ISP \\poly; 

— for each k € N, IS? \O(n*) C ISp,\O(n*); 

— for each k,l € N, IS*\O(n*) c 182.\O(n*). 
We also know little about the connections between complexity classes 
IS\F and IS\\F with IS c IS», and classical complexity classes. In 
particular, it is an open question whether there are classical complexity 


classes that coincide with the complexity classes IS"\ poly, IS? \\poly, 
and IS):"\poly. 


There are not yet indications that the above-mentioned open questions 
concerning proper inclusions of complexity classes [S\F and [S\\F with 
IS C [Spy are interdependent. 


It is easy to see that ISP .\poly coincides with the classical complexity 


class L/poly. It is well-known that, for all f : B* > B, f € L/poly iff f 
has polynomial-size branching programs (see e.g. Theorem 4.53 in [23]).° 
Let (fnnen € IS? \poly. Then, for all n € N, the thread produced by the 
instruction sequence that computes f,, is in essence a branching program and 
its size is polynomially bounded in n. As a consequence of this, IS? \poly 
coincides with L/poly. 


°L is the class of all f:B* > B that are logarithmic-space computable, see e.g. Chapter 4 


of [1]. 
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The approaches to computational complexity based on loop pro- 
grams [19], straight-line programs [16], and branching programs [13] appear 
to be the closest related to the approach followed in this paper. 

The notion of loop program is far from abstract or general: a loop 
program consists of assignment statements and possibly nested loop state- 
ments of a special kind. Loop programs are nevertheless closer to instruction 
sequences than Turing machines or Boolean circuits. After a long period of 
little interest, there is currently a revival of interest in the approach to issues 
relating to non-uniform computational complexity based on loop programs 
(see e.g. [4, 18, 20]). The notion of loop program used in recent work on 
computational complexity is usually more general than the one originally 
used. 

The notion of straight-line program is relatively close to the notion of 
single-pass instruction sequence: a straight-line program is a sequence of 
steps, where in each step a language is generated by selecting an element 
from an alphabet or by taking the union, intersection or concatenation of 
languages generated in previous steps. In other words, straight-line programs 
can be looked upon as single-pass instruction sequences with special basic 
instructions, and without test and jump instructions. To our knowledge, the 
notion of straight-line program is only used in the work presented in [2, 16]. 

The notion of branching program is actually a generalization of the 
notion of decision tree from trees to graphs, so the term branching program 
seems rather far-fetched. However, branching programs are in essence 
threads, i.e. the objects that we use to represent the behaviours produced 
by instruction sequences under execution. Branching programs are related 
to non-uniform space complexity like Boolean circuits are related to non- 
uniform time complexity. Like the notion of Boolean circuit, the notion of 
branching program looks to be lasting in complexity theory (see e.g. [23, 24]). 

The complexity class IS,,\\poly can alternatively be defined in the same 
style as IS,,\poly in a setting that allows instruction sequence splitting. 
In [7], we introduce an extension of PGA that allows single-pass instruction 
sequence splitting and an extension of BTA with a behavioural counterpart 
of instruction sequence splitting that is reminiscent of thread forking, and 
define IS,,\\poly in this alternative way. 
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